Dynamic Programming for Discrete-Time Finite Horizon Optimal Switching Problems with Negative Switching Costs
نویسنده
چکیده
This paper studies a discrete-time optimal switching problem on a finite horizon. The underlying model has a running reward, terminal reward and signed (positive and negative) switching costs. Using the martingale approach to optimal stopping problems, we extend a well known explicit dynamic programming method for computing the value function and the optimal strategy to the case of signed switching costs. MSC2010 Classification: 93E20, 60G40, 91B99, 62P20.
منابع مشابه
Finite-Horizon Optimal Control of Discrete-Time Switched Linear Systems
Finite-horizon optimal control problems for discrete-time switched linear control systems are investigated in this paper. Two kinds of quadratic cost functions are considered. The weight matrices are different. One is subsystem dependent; the other is time dependent. For a switched linear control system, not only the control input but also the switching signals are control factors and are neede...
متن کاملSolving finite time horizon Dynkin games by optimal switching
This paper uses recent results on continuous-time finite-horizon optimal switching problems with negative switching costs to prove the existence of a saddle point in an optimal stopping (Dynkin) game. Sufficient conditions for the game’s value to be continuous with respect to the time horizon are obtained using recent results on norm estimates for doubly reflected backward stochastic differenti...
متن کاملOptimal Finite-time Control of Positive Linear Discrete-time Systems
This paper considers solving optimization problem for linear discrete time systems such that closed-loop discrete-time system is positive (i.e., all of its state variables have non-negative values) and also finite-time stable. For this purpose, by considering a quadratic cost function, an optimal controller is designed such that in addition to minimizing the cost function, the positivity proper...
متن کاملOptimal Liquidation in a Finite Time Regime Switching Model with Permanent and Temporary Pricing Impact
In this paper we discuss the optimal liquidation over a finite time horizon until the exit time. The drift and diffusion terms of the asset price are general functions depending on all variables including control and market regime. There is also a local nonlinear transaction cost associated to the liquidation. The model deals with both the permanent impact and the temporary impact in a regime s...
متن کاملAn efficient algorithm based on eigenfunction expansions for some optimal timing problems in finance
This paper considers the optimal switching problem and the optimal multiple stopping problem for one-dimensional Markov processes in a finite horizon discrete time framework. We develop a dynamic programming procedure to solve these problems and provide easy-to-verify conditions to characterize connectedness of switching and exercise regions. When the transition or Feynman-Kac semigroup of the ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2015